r 



DOCUMENT RESUME 



ED 066 582 

I ■ ■ AUTHOR 

J TITLE 

1 .. L ' . 

1 INSTITUTION 

X N 

SPONS AGENCY 



REPORT NO 
PUB DATE 






NOTE 

EDRS PRICE 
DESCRIPTORS) 



! VT 016 *33 

' i 

O'Reilly, Patrick A. 

Evaluation of In- School Success Criteria for 
Vocational-Technical .Students. 

Pennsylvania State Univ., University Park. Dept.- of 
Vocational Education^ 

P ennsylvani a State Dept. of Education , Harrisburg. 
Bureau of Vocational, Technical, and Continuing 
/Education. 1 

VDS-Monog-6 

May 72 



82 p. 

MF-10 .65 HC-13.29 

Academic Achievement; Evaluation; School Shops; 
♦Secondary School Students; ♦student Characteristic^; 
♦Success Factors; Values; ♦Vocational Development;- 
Vocational Education 



r 



'i ■ 



ABSTRACT ' I • - \ . ' ' 

To further) understanding of the vocational 
development process, this study examined .the relationship among 
various measures of in->school success/ land investigated their 
relationship to selected student characteristic variables. The sample 
consisted of 109 vocational students for the 10th grade phase and 105 
of the same students for the, 11th gifade phase. The dependent 
variables (measures of success) were, grade point- average (GPA) for 
Grades 10 and 11, shop grades for Grades 10 and 11, and Ohio Trade" 
and Industrial Achievement Test (OTAT) raw scores, while independent 
variables consisted of: (1) ability measured by selected scales of 
the General Aptitude Test Battery (GATB) , (2) occupational values as 
measured by four scales of the ^Occupational Values Inventory (OVI) , 
and (3) vocational maturity as measured by the Vocational Development 
Inventory (VDI) . Analysis by means of— Pearson product moment 
correlations ; and multiple regression analysis yielded these findings: 
(1) Grade ll GPA was found to be most predictable and OTAT least 

predictable ;of/ school success* (2)-Verbal aptttude*~ numerical 

aptitude,- vocational maturity, and value of salary seem tb be the 
most useful of student characteristics used in predicting the 
measures of success, and (3), Grade 10 shop grade is the only success 
measure in, which manipulative abilities are important predictors. 
Implications are discussed. (SB) 
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PREFACE 



! ".I 



0 As the sixth monograph in the Vocational -Development Study (VDS) 

■ , 1 ■ - 
series, this study is one pf >a continuing research effort being under- 

• ‘ - ' s 

taken in the Department, of Vocational Education to develop a greater 
/ ■ ’ . .. 
understanding of the vocational development process. = f 



In a number of previous VDS research efforts, it was necessary to 
utilize a measure of in-school success and for different purposes various 
measures were selected .^In this~report; 0 ’-Reilly- has attempted to 



examine the relationship among the various measures of in-^school success 
commonly used and to investigate their relationship to -selected student 
characteristic variables. He has also proposed a model which ties 
together the various success measures and which ig_ supper te«L=by the 
iresults of this study. Although the relationship between in-school 
success and success in life was ndt examined in this study, future VDS 

, • . ; • ■ : V 

studies will attempt to explore this aspect of the model further. 






During the completion of this monograph, the VDS project 'staff andV- 



the Department of Vocational Education experienced theTTfagic .loss of 
its "leadership when Dr. Joseph T. Impellitteri was killed in an auto u 
mobile accident enroute to a career education confelrence at Ohio State 
University. It is hoped that this VDS monograph and those which will 
follow will continue in the direction which he had intended. ' 



Jerome T-r Rapes, Assistant Professor 
Graduate Studies and Research ' 
Department of Vocational Education 
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VDS CAPSULE OF FINDINGS AND IMPLICATIONS 



This section is intended to ptoyi.de a brief but thorough n umma ry of 
.this -study Which will be of practical! value - to /teacher.8,' counselors » ji 






• i'/ ■ .. .. 

administrators, and other school personnel. It is hoped that ninth, 
grade counselors apd those persons associated with vocational programs 

will find it to contain practical and useful’ inf ormaMn n, In li ght of - 

• ■' ’’ ' ' / 

the objectives of this section, the following discussion will be as 

brief as possible. / 

. * 1 • * ' . • e - *- * ’ •. _ « , ’ - . e>- 

- ; • y • *■ 'Z ‘ ■ . i . ; • •-/*. 

Finding's ■ . ‘ ; ! . t - •• \T ' 

1. This ptudy attempted to predict in-school success criteria using 

sixteen student characteristics, Of the five criteria of success i 

investigated in the study, GPA (11th Grade) was found to be most 

•• • ■ . * • ... - , ’ 

- predictable and OTAT was found to he least predictable. The~ 51 f : 
other success criteria in terms of predictability were: Ship 

. i . j. c . * ■ . . . . ■■ , • • ” v?/ > ■ • ‘ . a . * . 

; \.; t! ...... . • .-r ‘M, l , . 

Grade (11th Grade) second, GPA ( 10th Grade) third , arid Shop 



■V: 



Grade (10th Grade) fourth. 



u- 



2. Exceptlng Shop Grade— (10th . Gr%de)'i _ all“6f the Tarious^uccesiTJ' 

- measures were found to be related, However , this relationship 

gets weaker as the t I sm span between the measures increases^ ' 

3 . Ninth grade student characteristics jbecome more predictive with 
time i That is , thejr predict- GPA^ (litl^Grade) better than GPA 

t (10th Grade }v ; : j . • .;X;Vl T: ! ; J:Lr "i v r V. 



. 7 ' /* • , . .. . . “* / ■ 

A. Verbal aptitude, numerical aptitude, vocational maturity and 
value bf /salary seem tobathekost useful of tiam 'student. 



"V.\ ■ V 



characterise ice jueed In. predicting all five measures of 



success. 
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" v v f . ' 
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viilv , • / - ’• . 

■ ‘ ; * - /. " . . . „’;V- 

5* • Shop Gxade ; (10th Grade) is . the only success measure in /thich - 

" •- « i . i, . . * . / 

manipulative abilities are^lmportant predictors s/I 
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Implications 



P^-Y 



1. Verbal and numerical aptitudes play an Important rqle In 



■ / ' 

V. • 



vocational curriculum. It should be 



achievement within the 



remembered „ however, that they are not so important as to 



ft 



exclude other variables such as attitudes ind values. The 

.. ' I . " 1 

■ ' „ ,, - • . * •. 

results of this study merely server to re-emphasize that the 

student who Is below average _in^erms_of communications and 
computation ekills wlll have difficulty in achieving no 



T. 



r\ 



- .• 



matter whal: curriculum he Is enrolled In. 



2. Because of 

t 






id ( ii 



J - 

t- •• - 



the relationship among the' success Criteria/ a 

■ ■ i, ■ 



student who jls successful in terms of specific shbp experl-/ 



i • r 



./ ■ 
i . . ; 



— r 1 — ence la likely to be successful in the overall educational 

& ..... • o ■ 

■ .■ i-iM ' 

system. ; However, .* «*pecifie>, type of success is still best 
measured in terms of a given criteria. For example, GPA 
. best measures silccehs in the overall educational system 1 
, while shop ; grade fyes t ; measures success in a specific voc a- 
tional course. This is, of course, what, would l^ve bdSn‘" M: 

- expected. . y '"‘'.X ' ' - I 

3. Manluplatlve abilities, seem to be important in determining 



,, 






s- 









t - 
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-'ll 






’j . o ■ ~5j 






• T 



-^success in tenth gr ade shop In .eleventh grade, these 



abilities are .less important . This ma yindlcate that b y 



the elSyenth year, students have become more uniform in 



, . „j.. H 



■ 17 . 



terms of manipulative ability. As the student pregreases 



X.x: 



r. 



to the eleventh, year shop , cognitive skills, attitudes. 



0 ;? 






L- 



: -r 

i 



k V" 



• 7 - 



- f/x. ^ 
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and values seem to become more important In determining student 



A 
') . 



achieveinent. 



P- 



i 



( ■ 



A* Vocational maturity and value of salary are quite Important in 

‘ (II r f\ ~ . . ' • ’ , '* • • - , - 

,_,U T— — — - ^eterming-BOCcess in the Overall educational program. That 



is, the student who sees the relationship between 'all of his 



/f 



h. ,Ml 



educational endeavors and his occupational goals, and who is 
----capable of delaying gratification in - terms - of salary Will “more 
—likely achieve better in terms of both GPA and Shop Grades. 



I 






- — — A 1 , 



/'This finding offers a very real challenge— for educators to v 

%r— ' " 






show vocational students>he relationship and value, of-all 



■L ■' 1 






of their educational experiences to the attainment of future 



■/ 



x i 



. ( , occupational gratifications 
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ORIGIN AND IMPORTANCE OF THE STUDY 



t 



f . T~ • 

I ntroduction 

Some form of occupational education h#s taken place since the begin-- 

ning of time* This educational process has progressed from the informal 

■j ■ * ' . i 

father-son and apprenticeship relationships to more formal teacher-student 

relationships. Within the United States, the beginning of formal! occupa- 
tional education can be traced to thesloyd and manual training movements 
of„ the late 1.8.00’s and early 1900*s. The influx of federal funcjs with 
its need for accountability- began ' in 1917 with the Smith-Hughes Act which 1 






allocated approximately seven million dollars for vocational education. 

Since' 1917 the amount of money allocated for vocational education at the 

0 

federal level has increased to approximately 446 million dollars in 19/1 

I 

rkett, 1971). The objectives of vocational instruction have changed 






from merely teaching \the skills necessary to survive to providing those 
technical and specialized skills, knowledges and attitudes which will 
enable the student to earn a comfortable /living. 

Along with the development of^ an educational system, a systenj to 

measure the student s success in mastering the instruction has also been 

( 

developed, This latter system is based on the assumption that a student’s 
success in later life is related to his mastery of the instruction. The 
student’s mastery of instruction is also predictable to some degree by 
personal characteristics. In early time* -the ability to provide 'the 
family unit with food in the form of /Wild game may have been a measure 
of successiin life. The ability to shoot an arrow straight may have been 
a measure of success in mastering instruction, and predictors of this 

r- 'I. 












success may have been physical strength, steadiness xrf serves and keenness 
of eyesight. Modern day measures of success in life might be affluence, 
position in the community or ..occupation, in terras of educational, success, 
modern day measures that are often used are grade point average (GPA), 
particular class grades and standardized test scores. Predictors of 

1 r 

these measures of success in ' school are abilities and other personal 
characteristics. The degree to which a student displays these character - 

' ; r- - . 

istics is predictive of his educational success* | 

Increasing money for vocational education has brought ever increas- 
ing need for justification and evaluation, and has led to , the need to 
develop appropriate measures of success for both product and process. 

(One of the basic assumptions about educational success is that the 
degree of educational success is indicative of the degree of success in 
life upon completion of the educational process). These measures of 
success may be either subjective or objective in nature thus influencing 
the reliability of their results as predictors of success in other situa- 
tions. The development of objjective instruments for measuring skills and 
knowledge taught by vocational education is at a relatively early stage 
when compared with the more academic areas of education as a whole. 

Standardized achievement tests are usually designed to measure 
knowledge or performance. The first standardized tests were developed 
to test for knowledge acquired and were of the pencil and paper variety. 
Measures of performance have been developed more recently and are 
generally of two types, competency measures of cognitive skill and "hands 
on" type of observation which attempt to measure manipulative skill, . 
Problems have been encountered in standardization due to the fact that 



performance measures must be administered to either small groups or 
single individuals at a time. This makes it very difficult to hold all 

./ ■ i 1 

factors constant. By contrast, most knowledge measures \aay be adminis- 
tered to a large group of subjects quite readily. 

A recent development in objective type^ of instruments for vpca- 

■ . i .■ . ■ i v 

tional education is the Ohio Trade and Industrial Education Achievement 

Test (OTAT). Finch and Bjorkquist (1970, p. 38) state: 

■ : ; . i • 

"In recent years, standardized achievement tests have 1 

been developed which show great promise in the measurement ) 

of learning outcomes (Ohio Trade and Industrial Education 
Services, 1970; Baldwin, 1969). These measures have been 
painstakingly developed and report high test and subtest 
reliabilities." 

Because the subjective measures of success have been used for a 
longer period of time, they have tended to become the criterion against 
which the newer objective measures are judged- Long and Rapes (1970) 
conducted a study to determine the relationship between OTAT total test 
scores and end-of-cour se shop grades. They report that'the OTAT may 
validly measure knowledge of course content but that this is only a 
small portion of what instructors use to determine grades. Likewise, 
for vocational students, success in terms of shop grade is only a part 
of the measure of success/in the total educational process. Tradition- 
ally, total educational Ysuccess has been measured in terms of overall 
performance, usually interpreted as total grade point average (GPA) . The 
relationship of these three measures of success as well as their rela- 
tionship to success in life is visibly depicted in Figure 1. 

C 

From Figure 1, it is shown that "success in life” is dependent upon 
success in many areas of life. One of these areas is educational success. 
Educational success is made up . of success in many areas. An index of 



SUCCESS / ■; ^ SUCCESS IN SCHOOL 






FIGURE 1. Relationship Among Success Measures 



/ 




educational success is GPA. GPA is a cumulative average which reflects 
how much the student learned in all of his m-school activities. Because 
the vocational ' student spends approximately fitly percent of his time In 

l' . ' 

the vocational shop, shop graded would make up fifty percent of the "in- 
school" success. Shop grade is based on the instructor’s evaluation of 
the student's performance with regard tc knowledge cognitive and mani- 

. i 1 I 1_ . ■ ' ‘ ‘ 1 • • ; ' 

pulative skills, attitudes, an^ other factors which he may consciously 

or uncons ciouslydeem important. Standardized "pencil and paper" tests 

/ 1 

such as the OTAT measure knowledge and cognitive skills and as previously 
discussed, these represent only a part cf the entire shop grade. Because 
GPA, shop grade, and OTAT score are criteria of success; and given that 
they measure different aspects of success as conveyed by Figure 1, it 

, ' • ' ' f 

becomes necessary to examine the degree of relationship among them, 

Cooley and Lohnes (1968) developed a career theory based on a career 
tree concept. The career tree depicts paths which may be chosen during 
the career development process. The path which is chosen is determined 
by decisions made at points in time with reference to education, interests 
aptitudes, etc. Rapes (.1971) as reported in VDS Monograph Number 2, 
found that success was an important concept in the development__of a 
career tree. Thus, it is important to determine the relative merits of 
the various school success measures now in use. Since, in fact, more 
than one type of school success does exist, it becomes very important to 
know how the various measures of success are related to each other and 

* 

to various predictors of success. The greater the relationship among 
the criteria, the less critical the decision of choosing a criterion with 
which to measure the student's success. 



0 J 

ERLC 



» 
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A 



If, in fact, the criteria are different, it then becomes important 



to determine what ninth grade characteristics are important in predict- 
ing., success ~in termd of the different criteria. This information will 
be /quil^e useful to counselors in encouraging students to capitalize on 
their ptrong characteristics and strengthen! those that are weak. It will 
help the counselor to show the student where he Is likely to succeed and 

a . ^ . 

< . - . < I . ' “ 1 

where he is likely to encounter difficulty. Another important outcome 
of determining the predictors of each of the criteria is the determina- 
tion of whether or not they measure what they are supposed to measure. . 
That is, does the OTAT measure knowledge and cognitive skill, the shop 
grade specific occupationally related skills, ^knowledge, and attitudes, 
and GPA a broad variety of skills, knowledge and attitudes. For’ example, 
the OTAT should be predicted by cognitive aptitudes,' shop grade ( by a , 

combination of abilities and certain personality characteristics and GPA 
* -+ / * ’ 
by a broad range of abilities, personality characteristics and background 

measures. 



Statement of the Problem ~ , 

• ! 

In order to attempt to explain and discover patterns of vocational 
development in secondary students, a longitudinal research effort was 
begun at The Pennsylvania State University in 1968. It is in support of 
and in conjunction with this continuing effort that thi^s particular study 
was initiated. In attempting to predict success as measured by GPA, 

Kapes (1971) utilized sixteen selected ability, achievement, and socio- 
economic variables. Enderlein (1972) investigated the relationship 
between success as measured by total OTAT score and selected ability 

measures as well as choice of trade area in terms of whether or not the 

■ n ...... , . . ‘ . ■ ■ 
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n- 




student was assigned to the trade area which was his first choice. 



The 



J ■ 

\ 



:'-7 
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same student characteristic variables which were used in these two pre- 
vious studies w ete also used in this study^except for choice of trade 
area used in the Enderlein study. 

For the purposes. of Lthis study, the following student characteristics 
were selected for use based on the two studies previously cited: General 

Aptitude Test Battery (GATB) scales V, N, S, P, Q, K, F and M. Occupa- 
tional Value Inventory (OVI) scales, Interest and Satisfaction, Salaty, 
Prestige, Security, Vocational Maturity as measured by the Vocational 
Development Inventory (VDI), Father's Educational and Occupational Level, 
and the student's Level of Occupational Aspiration. The five criteria 
which were chosen follow directly from the mo;del showp in Figure 1. These 






i • ■ • 

are tenth and eleventh year grade £oinfc average (GPA) ,, tenth and eleventh 

year shop grade, and total OT AT raw score at eleienth year. 

In an effort to further fexplore the use of CPA, shop grade, and OTAT 
total raw score as success measures, the- following questions were answered: 

1. What is the relationship among the five measures of school 

success? , 

2. Which combination of nintjv-g^ade student characteristics 
most efficiently predict schtjol success ( as measured by 
tenth year GPA? 



& - 



3.' Which combination of ninth grade student characteristics 
most efficiently predict school success as measured by 

t . 

tenth year shop grades? 

A. Which combination of ninth grade student characteristics 
most efficiently predict school success as measured by 
eleventh yea^GPA? 
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REVIEW OF RELATED LITERATURE 



• ' Introduction 

In an effort to identify other studies and articles which contain 
information pertinent to this study a review of the literature was - 
undertaken. The literature was grouped into the following^ categories: 



1. Studies and publications concerning the student character- 
istic variables used in this study. 



2. Studies and publications concerning the various measures of 
success used in this study. 



3. Studies and publications relating to and/or supporting the 
methodology and techniques used in this study. 



4. Studies and publications concerning the relationship between 
in-school and out-of-school success. 



Because of the relationship between this study and previous studies, 
specifically Rapes (1971) VDS Monograph Number 2, entitled The Relation- : 
ship Between Selected Characteristics of Ninth Grade Bovs and Curriculum 



Selection and Success in Tenth Grade and Enderle.in (1972) VDS Monograph 
Number 4, entitled An Examination of the Relationship of Selected Student 
Variables to Vocational-Technical' Shop Achievement, an extensive dis- 
cussion of the first three categories will not be conducted in this 
study. Rather, reference will be made to the previous studies. Only 

t ^ 1 ' % f 

the fourth category and recent studies pertinent to the first three catte- 

! . 

gories which were not previously discussed will be treated at any length. 



Studies and Publications Concerning • the Student 
Characteristic Variables Used in Thie Study 



The following literature has been extensively discussed by Rapes 
(1971) in VDS Monograph Number 2. Should any particular , study be of 

T'-' ■ - 19 
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farther interest, reference should be made to the previously mentioned 
study. The following summary is taken- from Rapes (1971) VDS. Monograph 
Number 2^ pp. 56-58. .... 1 ; • •• ~ \ . . 



3§uuuary 

■ 1.,' As a multiple ability measure, the 



!ATB appears to bd 



very complete and extremely useful ior studies related 
to adolescent career decision making and school achieve- 
ment in both the academic and vocational— technical areas 



. (Droge, 1965, 1966; Impellitteri and Rapes, 1969; 

Ingersol and Peters, 1966; Rapes, 1969a, 1969b; Pickect, 

1958; Samuelson, 1956; Super and Crites, 1962; tT.~~S. 

Department of Labor, 1967) , 

: . . r 

2. Occupational jralues as a career development construct 

is receiving increasing attention and appears to possess 

* . 1 ’ - 

valid and useful relationships to many of the student 

I 

behaviors of interest in career development research 
(Dipboye and Anderson, 1959; Gribbons and Lohnes, 1965; 

Rapes, 1969; Rinnane and Pable, 1962; Singer and 

• ' . • • . ■ & 

Stef fire, 1954; Sprinthall, 1966; Super, 1962; Thqmpsbn, 

1966; and Zytowski, 1970). ' 

3. A strong argument can be made for the essentiall^\ipsa- 

tive nature of occupational values (Beck and Barek, 1967; 
Impellitteri and Rapes, 1970; Rapes, 1969; Ratz, 1963; 
and Zytowski , 1970) . 

4. The VDI appears to be one of several possible valid 




has been shown to be related to Intelligence, age, grade 
sejx, curriculum, choice and socioeconomit status (Asbury 
1968; Bathory, 1967; Crites, 1965, 1969; Crites and 
Samler ,'1967 ; Dutt, 1968; Gribbons and Lohnes, 1968; 
Holloway, 1967; 'Impellitteri * et al., 1969; Pucel, et al 

■ I ' 1 

1970, 1971). 

■ • i • ■ ■ ' ' ' 

The two variables, father's educational and occupational 
level, appear to contain enough" inf ormatioh to be repre- 
sentative of a student's socioeconomic background (Blau 

*. i 

and Duncan, 1967; Holllngshead', 1949; Reiss, et al., 
1961; Super and__Oyerstreet, 1960; Warner, 1949). 

A student s socioeconomic level has been shown to be 

‘ ' % 

related to his intelligence, vocational aspirations, 
curriculum choice, school participation, school grades, 
and overall achievement as well as to other measurable 

characteristics (Bachman, 1970;' Blau and Duncan, 1967; 

. ( • -• 

Clark, 1967; Gribbons and Lohnes, 1966, 1968; Holllngs- 
head, 1949; Krippner, 1963; Super and: Overstreet, 1960; 
Weinberg and Skager, 1966). 

An individual's level of occupational aspiration has 
been shown to be both a predictor and a resu ltant of 
his^ interaction with his environment, and is stable , _ 

enough at the ninths grade level to be useful in 

( ' 

developmental research (Asbury, 1968; Bachman, 1970; 

. l » 

Bathory, 1967; Clark, 1967; Flanagan, 1966; Gribbons 
and Lohnes, }.966, 1968; krippner, 1963; Miller and 
Haller, 1964; Montesano and Geist, 1964; Super 
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.Overstreet, 1960; Thomas, 1965; Whitney, 1969) 
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Studies and ' Publications Concerning the Various Measures 

of Success Used in This Study ■ 1 

i . « ..I . J ' " ' ■ 1 

J Enderlein (1972) found the OTAT to be a useful instrument in evalua- 
ting cognitive skills arid knowledge in terms of a vocational progrdm, 

• , i • • . * : ' 

however, it was not found to be useful in assessing manipulative skills. 

The studies listed under 1 and 2 in the summary have been reviewed at 
length by Enderlein (1972) in VDS Monograph Number 4, and will not be 
reviewed here. Further information about these studies can be obtained 
by referring to VDS Monograph Number 4. 

The following literature relates to the use of GPA or Shop Grade as 
a criterion of success. Since they have not been reviewed in either VDS 
Monograph Number 2 or Number 4, they will be reviewe)^ here. 

Finger (1966) in an article Academic Motivation and Youth-Culture 
Involvement; Their Relationships to School Performance and Career 
Success used GPA as an Indicator of school achievement. GPA was then 
related to persistence and choice of occupational area. In both casps , 
the relationship was found to be significant. ' ' 

Hoyt (1966) conducted a review of research entitled College Grades 

and Adult Accomplishment . It was concluded" that GPA, or a specific course— 

\ 

grade may not be a completely valid measure of in— school achievement; - 
however, they are usually the only assessments made. Therefore, until 
modifications are made in the process of grade assignment, they are the 
only assessments available at this time. 

✓ 

A comprehensive review of research dealing with success was under- 
taken by Calhoon and Reddy -(1968) . Fifteen studies were found which 

i • - . . 

utilized grades as ln-school success criteria. - Over half of these studies 

^ ----- '' ' 



) .. • 



\ 




’seemed j . o show some connection between grades and ability. 

Kapes an<^ Long (1971) conclude^ that shop grades include many factors, 
other than ability or knowledge, which had not been identified. Addition- 
ally, the OTAT is useful in assessing knowledge of course content; but 
measures only a small portion of those factors considered by shop instruc- 
tors in assigning grades. 

Kapes (1971) found GPA to be a useful criterion in distinguishing 
between successful and unsuccessful male students. GPA, therefore, appears 
to be a valid measure of overall in-school success. 

Enderlein (1972) was unable to determine if end-of-course shop grade 
was ,a valid measure of achievement. However, as previously discussed, the 
OTAT was determined to be useful and shop grades were found to correlate 
significantly with OTAT scores. • 

Summary . 

1. The OTAT is a useful instrument relative to evaluation of 

' learning outcomes (Baldwin, 1969; Finch and Bjorkquist, 

1970; Kapes and( Long, 1971; Enderlein, 1972). 

* 

2. Caution should |pe used in certain applications^^ the 

OTAT (Finch and Bjorkquist, 1970^ Kapes and Long, 1971; 

Moss and Stromsdorf er , 1970). 

3. Grades, jboth GPA and for specific courses ^ seem to have 

value as indicators of in-school success.’ (Finger, 1966; 

Hoyt, 1966; Calhoon and Reddy, 1968; Kapes, 1971; • 

k,- . 

Enderlein, 1972). 
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Studies and Publications Relating to. and/or Supporting . 
the Methodology Used in This Study 

.i ■ , _ , " ».i . i ‘ 

Kapes (19/1) utilized a multiple regression analysis (MRA) in his 
study published as VDS Monograph Number 2. A step-down technique was 
also found useful in computing restricted models. The following studies 
were reviewed ejlfcensively by Kapes in VDS Monograph Number 2 and, there- 



fore, will be only listed here. Further information can be found by 
referring to the Kapes study . . ; 



V 



0 



Summary _ p-* 

- — v 

1. Multiple regression analysis appears to be a useful sta- 
C tistieal technique for use in the' behavioral sciences 

_• . , (Totsouka, 1957; Kaufman, et al,, 1967; Rulon, 1967 ; 

Cooley and Lohnes, 1968; Moss, 1968; Super 1969b; 
Sonquist, 1970; Hu, Lee and Stromsdorfer , 1971; Kapes, 
i.971 ; Wallberg, 1971). 



Studies and. Publications Concerning the Relationship 
Between In-School and Out-of-School Success 



fN. 

\s>. 



One of the biggest problems in studies of success is the definition 

of success. What is success? Super (1951a) said: 

“V. > • 

"Success^" as the world judges it^^is fruitless and 
empty unless it is also seen as succes^by the in- 
dividual. What would wealth have been to Ghandl, or 
the ’love and respect of humble men and woman to , 

Bisoiark? What use had Thoreau for prestige and 
status, or Theodore^Roosevelt for opportunities to 
be alone with ^piself and the universe? In .the eyes 
of each of these persons, artd of some others, each 
of them was successful; but in the judgment of many, 
each of them was a failure. Individual values and 
hence individual judgments, differ in such matters. 
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Success is extremely hard to define and any particular definition will 
probably not be accepted by all individuals. 

— Crites (1969) devotes considerable energy to exploring the different 
criteria which have*been defined as vocational success. Some of the 
criteria that have been used in the past Include quality of work, quantity 

of work, advancement, self or supervisor ratings, and earnings. Crites 

\ 

concludes by suggesting that a good success criterion would combine many 
of those criteria previously used. This would create a criterion which 
would be more universely acceptable. It would also have the effect of 
1 ipaking i success research more difficult- The following studies should be 
considered while keeping the specific criterion used in mind. 

Finger (1966) studied the success of 1947-1952 graduates of Brown 
University. It’ was found that the degree of in-school success had an 
effect upon career choice. Careers were defined as either business or 
professional types. It was also found that once the type of career was 
chosen, in-school success was related to out-of-school success. The 
criteria for success in business type careers were income and position. 

For professional type careers, the criteria were type of position and/or 
income, ' - * 

Calhoon and Reddy (1968) compiled a review of fifteen studies of the 

relationship between in-school success and out-of-school success. Salary 

. . * > 

was used alone in eleven of the studies as the success criterion. The 
remaining studies used supervisor ratings, performance appraisals, and 
various combinations of variables as the success criterion. Of the 
fifteen studies reviewed, eight found at least a slight correlation between 
\in-school and out-of-school success. Several factors which may have 'con- 
tributed to findings of nft significant correlations were: (1) indications 

-~*tr • * ; ... ' • ' 

' • r • • : 



/ 



16 

• 'j, 

that non-respondents tended to be below average in grades and salary, and 
(2) the fact that business careers were combined with low-pay professions. 
There are indications that a considerable number of highly successful 
students chose low-pay professional careers. Thus, salary alone is not 

• . . ■ ‘ I . 

a completely valid success Criterion. The man/ problems in defining 
success are again discussed in the Oalhoon and Reddy article. 

Coppedge (1969) investigated the relationship between several in- 
school measures of success and occupational success. Occupational success 

II ' • ‘ 

was determined by salary and ratings made on each employee by the employer 

The relationship was not found to be significant at the .05 level, How- 
• • . •• . • ' I i' 

ever, the follow-up was conducted only four years after high school 

■ i 

graduation. 

Cox (1971) defined a vocationally successful person as one who was 
working in a trairting-related job five years a^ter graduation from a 
trade-technical or business school; was satisfied with his present job; 
felt the work was appropriate for him; had received an increase in wages, 
and had exhibited job stability. No significant relationship was found 
between this definition of occupational success and in-school success. 

This author repeats the problems involved in defining success. 

Summary 

1. Success is extremely difficult to define and the definition 

may effect study results (Super, 1951a; Crites, 1961; 

Calhoon and Reddy; 1968; Cox, 1971). ■ " : 

} ( • •• : 

2. There appears to be some relationship between in-school 

success and out-of-school success (Finger, 1966; Calhoon ‘J • 
and Reddy, 1968). 
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III 

PROCEDURES 

Population and Sample 



A 




The hypothetical parent population to which the results of this 
study may be generalized would consist ' of what might be called average 
American high school students enrolled in those vocational shops for 
which Ohio Trade and Industrial Achievement Test (OTAT) is available. 
Because of the difficulty involved in describing an average Ame~ can 
student, caution' should be used when making generalizations and applica- 
tions to students outside the actual-parent population. To be included 1 
in the sample, subjects must have enrolled in a vocational program for 
which the OTAT was available and have taken the OTAT. These subjects must 
also have remained in school and in the same program at least through 

\ their eleventh grade year. 0 The vocational programs for which the OTAT 

■ / , 

was available were: Auto Mechanics, Electricity, Electronics, Machine 

Shop, Drafting and Design, Printing, §heet Metal, Welding, Auto Body, 
Carpentry, and Cosmetology. 

The sample contained 109 male and female students for the tenth 
grade phase. For the eleventh grade phase, 105 of the original 109 
students were retained • Three of the four Who were not retained were 
males who dropped out of school. The only other subject not retained 
wa6 a female who discontinued the vocational program. This sample con- 
tains part of the sample used by Rapes (1971) in a study of The- 

.1 — ; — 1 - . • « . v . ’ f \ _ . 

Relationship Between Selected Characteristics of Ninth Grade Boys and 
Curriculum Selection and Success in Tenth Grade (VPS Monograph, Number 2). 
In an effort to minimize redundancy, background material which is common t 




to both samples will not be repeated. Only those characteristics which 
are unique to the sample used in this study will be discussed. All data 
for this study was collected as part of a continuing longitudinal study 
of vocational development-being conducted by the Department of Vpcational 
Education at The Pennsylvania State University in cooperation with 'the 
Pennsylvania Research Coordinating Unit . ' 

Essential Data 

Independent Variables . Those student characteristics which were 
used as predictor or independent variables in this study correspond 
directly with those utilized by Rapes (1971) . Therefore, the rationale 
for their use will not be repeated and only a brief: description of each 
will be Included. 

Eight of the nine General Aptitude Test Battery (GATB) aptitude 
scores were used as ability measures. They were: 

V - Verbal Aptitude — The ability to understand meanings of,_ 

words, and to use them effectively. The ability to com- ! 
prehend language, to understand relationships between 
>. words and to understand meanings of "whole sentences and 
paragraphs. 

■ N - Numerical Aptitude — Ability to perform arithmetic opera-- 
t ions quickly and accurately. 

S - Spatial Aptitude — Ability to think visually of geometric 
forms and to comprehend the two-dimensional representa- 
tion of three-dimensional objects. The ability to 
recognize the relationships resulting from the movement 
of objects in space. 

P - Form Perception — Ability to perceive pertinent detail 
in objects or in pictorial or graphic material. Ability 
to make visual comparisons and discriminations and aee 
differences in shapes and shading of figures and widths 
***■• . and lengths of lines. ■- •' ' ' 

Q.- Clerical Perception— Ability to perceive pertinent 

detail in verbal and tabular- material . Ability to " • 
0bserve-4ifferences in copy* to proof: read words and’ • 



numbers, and to avoid perceptual errors in arithmetic 
computation. '' 

K - Motor Coordination— Ability to coordinate eyes and 
hands or fingers rapidly and accurately Ln making 
precise movements with speed . Ability to make a 
movement response accurately and, swiftly. 

F -.FJ.ngtr Dexterity— Ability to move the fingers, and' 
manipulate small objects with the fidgets, riapidly 
and accurately. „ ' . • ... 

M - Manual Dexterity — Ability to move the hands easily 
and skillfully. Ability to work with the hands in 
placing and turning motions. 



In order to obtain information on occupational values, the Occupa- 
tional Values Inventory (OVI) was used. Although the OVI measures seven 
occupational values, only four were used in this study. These four are: 

1 - Interest and Satisfaction-One likes the work, enjoys 1 . 

it, is happy at it, fulfills oneself by doing it. 

' V. ‘ ’ * ‘ 

2 - Salary— One perceives the financial return resulting 

from the york, cdn make— a~good living at "It , sees it ' ■ 

as an opportunity for a good income. 

3 - Prestige — One Is impressedjpy the respectability ' 

attached to the work, can earn recognition from it, 
desires the feeling of importance that goes with it. 

4 - Security — -One can obtain employment in this work, 

perceives that workers are needed in it, there will 
always be openings in it. ? 

The Vocational Development Inventory (VDI) was administered and used 
as an indicator of vocational maturity. Vocational maturity as defined 



by Crites (1961): ’ _ " - 

; . •• ' * * ‘ 

Refers to the maturity-of an individual's voca- 
tional behavior as indicated by the similarity 
between his, behavior and that of the oldest 
individuals in his vocational life stage; * v . - 

Two family background indices were selected for use in an effort to 



account for socioeconomic background. The two variables were father’s 
educational level and -father 1 s occupational level. Father's educational 



21 



level was coded from "1" being less than six years of formal education 
to "7" being education beyond the baccalaureate degree. Father's occupa- 
tional - leveT”was c oded according to~Roe ' s (1956) classification scheme 
with "1" being the highest level (Professional and Managerial I) to "6". 
being the lowest level (Unskilled). ■!' ' N •" s 

The' final independent - variable selected for use in this study was 
the student's occupational aspiration level. This was actually the level 
of the occupation to which the student realistically aspired according to 
Roe's (1956) classification scheme coded in the_sarae manner as father's 
occupational level. . 



Dependent Variables . Three criterion variables were selected for 



use in this study. All three are commonly applied to measure success in 
a particular phase of education or in the total educational proces s. 1 Of 
the three selected, two were collected at two points in time, these were 



grade point average (GPA) and shop grade. The remaining variable, OTAT 
total raw score, was collected at only one point in time. Thus, five 
criterion variables were used. ' — ' 



Success in the total educational process was measured by iGPA. 

Rapes (1971) used GPA as "a success measure in VDS Monograph, Number 2. 
For the purposes of this study, GPA was obtained at the end of both the 
tenth and eleventh grades. The GPA was computed by weighting the grade 
received in the vocational shop equally, with the total of all tnajor 
subject grades received in non-vocational subjects. Figure 2 shows the 
grading system used by the Altoona school system and some equivalents. 
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Figure 2: Altoona and Equivalent Grading Syatens 



Success in, the vocational curriculum was measured^fn two ways. The 



flrst^of these, shop grade, was also obtained at two points In tine. 



namely end of tenth and end of eleventh grades. Enderleln (1972), (VDS 
Monograph, Number 4) , utilized end of course shop grade as a measure of 
achlevenent lnhisstudy of vocational-technical shop achievanent , , 

(An Examination of the Relationship of Selected Student Variables to 

- . . .. .• ~ ^ 

Vocational-Technical Shop Achievement). 

It was assumed that an average grade In any two shops were equal 
Indicators In terms of student success, thus, raw shop grades. were used 
linstead'of standardized grades. This assumption was ♦based on findings by 



Rapes (1969, p. 11). ' ° ° ' 

Depending ph the grading system used in a school 



systsai and op the homogeneity of the grading 
practices, raw Score grades >sy be as useful as 



-v'v 



converted grades as a criterion oftralnlng success, r 
The final criterion variable selected for use In this study was r~- 
vOTAT total raw score which Is also a measure of success lh the vocational 



curriculum.; The OTAT is composed: of sub-tests and the number of sUb-tests 



\ 






varies with the shop! area. In addition, no reliability Information Is 



- -i 



available on the sub-tests, tyit reliability coefficients are reported for 









' .) I 





i * . . . ■ 


s ’ . l ■ ■ j •• 










^ — -, -r— ; 




— . 





■ :l •• •' 

i * 

' iii ■ ^ ■ 



ri ** 



. t „ 

r. -i' V • 

'"'V- • 






■>% 



ir 



y 









23 



o 



: /' 



\ . 
1 / 



the total test scores. For these reasons It was decided to standardize 

_ . ' ■ * • i _ 

the total raw scores over the entire sample, these standard scores have 
a mean of 500 and a standard deviation of 100. The OTAT total raw scores 
were obtained in March of the eleventh grade ydar. Further information 

■ 'o 

about the OTAT can be obtained by referring to Enderlein (1972) VDS 
Monograph, Number 4 1 ‘ 7 ' 

Analysis - ■ 

In order to provide meaningful, .clear answers to the questions 



proposed by this study, two statistical methods were employed. In answer- 

4 . v 

7 ' ing question 1* Pearson Product~Moment Correlations (PPMC) were used. 

o . , • c 

The other five questions were answered by using multiple regression 
analysis (MRA) . v j 

'' . ’ * 'I • .• : ' ' • 

In answering question 1, Pearson Product Moment Correlations were 

v . ' ' 1 • . ' ; ' ; '• • * 

used to test the degree of relationship among the five criterion vari-., 

ables. 



Dubois (1965, p. 157) offers the , following comments on the interpre- 
tation of correlation coefficients: • • 

• • i - • • . • . . . ■ ; . ■ 

Although correlations vary from .00 to 1.00 (and - 

negatively from .00 .to *-1.00), they cannot be 
. , considered as proportions (or percentages) . 

Basically, an r is merely the slope of the best- 
fitting, least squares line, after the variance 
of the two variables have been equalized . • 

Somewhat indirectly , r becomes a measure of 
relationship- by indicating (wheh squared) the 
propbrtions of the variance in, one variable ; 

predictable through knowledge of the values in 
the other! , . \ • ~ • 

The remaining five questions were answered using the following 

multiple regression model: 7 ■' - 
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y- b Q + b 1 ^ + b 2 x 2 + .. .b kXk 



+ e 







■ G 



where 

y * criterion or dependent variable 
' .. . • 

; x 2 . x^ ■ independent varl 

b o^ b i’ ’^2- - * * kfc “ Partial regression coefficients . ■ ^ \ 

e ^jerror term V 

The specific equation used was: ■■ 



y i ■ b o + b l X 1 + b 2 x 2 + 



b 16 X 16 + e 



where 



and. 



•v« ■ 

- J. 



y^ “ Tenth grade GPA 

y 2 = Tenth grade shop grade , 

yy = Eleventh’ grade GPA 

■ .rfT-t'rti '"{■/'•' i f : " r 

' ' . ' ' •: f * • * l 

y^ = Eleventh grac^p shop grade 

' ' ' i : • . * - . 

y P = OTAT total score 



x. = GATB— Verbal- Aptitude (V) 
x 2 = GATB — Numerical Aptitude (N) 
x^ ■ GATB — Spatial Aptitude (S) 
x^ '« GATB— Form Perception (P) 
jx^ “ GATB— Clerical Perception (Q) 
Xg ■ GATB — Motor' Coordination (K) 
x_ GATB--Finger, DeXtierity (F) > 

r v ■ ■ - • . i ■ 
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Xg = GATB — Manual Dexterity (M) 

I , x^ * Occupational Value— -Interest and Satisfaction 



x^q= Occupational Value— Salary 



x^= Occupatrphal^yalue — Pres tige 



x xi - Occupational Value— Security 



x 13 « Vocational Maturity 



x, .«* Father's Educational) Level 
14 



x^,/* Father's Occupational Level 

.. “ . U . * 

x 16 5 * Occupational Aspiration Level 



l : 



The use of the multiple regression technique allows the unique con- 
tribution of each variable to be tested for significance while holding 
the effects of all other var ^abl^ "* constant . K restricted model contain 
ing only those variables making a significant unique contribution to\ 

" ■ • ' • "" ' ■ 7 - 

explaining the criterion variable was calculated using a step-doWw 
technique. . .. ; • • 

Kapes (19^1) has outlined the specific assumptions and advantages 
of using this technique. Should these be of interest, reference should 
be made to VDS Monograph 2. The specific computer program used was~ 
Statistical Analysis of Single Equation Stochastic Models Using the 
Digital Computer written by Hallberg (1969). This program is available 
as QSASE at the Penn State Computation Center. 



Dbring the 



course of . this study, an alpha level of .05 was used to 



test all obtained statistics.: 
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IV 



FINDINGS 



Introduction 



Conclusions about the results of this study will be discussed in 
Chapter 5. This chapter will attempt to present the data as it pertains 
to each question. Whenever possible, findings will be presented in 
tabular form, however, some discussion will be necessary in order to 
avoid any possible misunderstanding. Discussion will be held to a minimum 

, v ■ • i 

and findings will be related to previous studies whenever possible. 

.• 4 ' 

In order to provide, 9 ^ ccomon base from which to work, means and 
standard deviations , for 'the sixteen student characteristic variables have 
been presented in Table 1. As can be sevm when comparing these findings 
with those of Rape 1^(1971) , the means and standard deviations are quite 
similar. The differences that occur can probably be attributed to the 
smaller, restricted sample used In this study. As pointed out by Rapes 
(1971) , rtrhese means and standard deviations approximate those figures • 
considered to be national norm? fot ninth graders. .... 

It is also necessary to examine the intercorrelatibns among the 
sixteen student characteristic Variables as this will improve insight 

■ 1 • I * ' . . ‘ ' ) 

v . *w 

into why some variables are more useful than others when combined in a'” 
Multiple Regression Analysis to predict the criteria. This information 
is presented in -Table 2. Table 3 shows the degree of linear relationship 
between the five criterion variables and the sixteen student character- 
istic variables, The degree of linear relationship is indicated by the 
zero-order correlation coefficient. This informatiorPcoupled with that 
in Table 2 should provide an intuitive feeling for, which student char- 



36 



27 



Table 1. Means and Standard ‘Deviations for the 
Sixteen Student Characteristic Variables 

. • \ . ' \ 



• : ; ^ : : J - ^ 


Variables 




. ■ ‘ • . N - 109 ' 




No. Name 




’ . • X ' ' SD 





1. 


GATB-- Verbal 


90.32 


8.83 


2. 


GATB — Numerical '' 


92.41 


11.04 


3. 


a • 

GATB — Spatial 


100.56 


14.85 


4. 


GATB — form Perception 


■ i . \ 

97.41 * 


. 17.89 




GATB--CleriCal' Perception . 


98.72 


11.41 • 


6. 


GATB — Motor Coordination 


87.76- : 


12.96 


7. 


GATB — Finder Dexterity 


91^61 


18.07 


8. 


GATB—Mahual Dexterity 


88.61 


17 >54 


9. 


Value — Interest and 




• - . - 




Satisfaction .7 


17.99 


4.65 


10. 


.Valuer — Salary ... .! 


__ 14.51 


6.31 


11. 


* n •• • , ’* 

Value — Prestige'. ' , " 

' - * i - ♦ 


\ 10.52 


4.77 


12. 


- \ . £ 

Value — Security *• 


_ -12.77. -! . 


4.94° 


13. 


Vocational Maturity 


34.80 


4.57 


14. 


Father's Education . j 


3.69 


j *1.04 


15 . 


• . ' 1 , # * ' ' ’ ' ’ ' 

Father's Occupation 


4.44 


. .81 

) , 


16 . 


Occupational Aspirations 


^ 3.37 

/ _ ' ■ 


.93 
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acterist.ic variables will .be useful, in predicting a specific measure o{ 

* school success* j * • ••’ 1 

■ .i i ' .v • • ■ : * ' . * • ' . 

, It might be helpful to include here a reminder before preceeding 
further in interpreting the correlations and partial regression coeffi- 
cients presented in any of the tables. When interpreting the relationship 
or predictive worth of Father's Occupational Level and Level of Occupa- 
tional Aspiration in light of any other variables, a negative correlation 
or- partial regression coefficient will indicate a positive relationship * 

' . . ' "" • j . ' ■ ■ ‘ 

This is true because of the way these two variables were coded. Both 
were coded uisng Roe's (1956) classification scheme where ."l" equaled the 
highest possible level. and n 6V . equaled the lowest possible level. Thus, 
these variables are negatively coded. This will rau&e the sign to be the 
reverse of what it should be when examining them in the light of any of 
the other variables. 

Finally, the tables presented in this study haVe been constructed to 
allow direct comparisons with those in VDS Monographs 2 and A. Since 
many of the student characteristic variables and school success 
measures used in this study overlap with the two previously mentioned 
studies, such comparisons will often be of inters^. , With these prelim- 
inary findings and remarks in mind, those findings pertinent to each 
question proposed in Chapter 1 will now be presented. 






Question //I 

. i • < 

What is the relationship among the five measures 

'• A-** . , 

of school success? 

. . l . 

In order to determine the degree of relationship among- the five 
measures of school success,’ it is necessary to refervto Table 4. 
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It should be remembered that both GPA and Shop Grade were obtained at two 
points in time, namely end of the tenth year and end of the eleventh 
year. . , . ' . 



Table 4. The Relationship Among the Five Measures 
of School Success _ < — 

1 (N *» 105) * 



- . X 11 


Variables j ' 


2 


3 


4 , 


5 . 




1. Shop Grade (10th Grade) ■ 

2. GPA (10th Grade) 


.67* 


..10 

.45* 


.07 

.52* 


.16 

.29* . 


’ 0 



3. Shop Grade (11th Grade) 

4. ; GPA (Hth Grade) , 

5. OTAT 



.84* 

, 



.40* 



.43* 



* Significant at .05 



As shown by Table 4, seven of the possible ten relationships among 



the five measures of school success are 'significant at the .05 leVel. 

The notuable 'exception is Shop Graide (10th Grade) which does not correlate 
significantly with any other school success measure except GPA (10th Grade) 

■ l * - . . • . ... . <-V 

It should be- remembered that in the computation of GPA (10th Grade) 

and GPA (11th Grade) the respective Shop Grade was us^d at 50 percent of 

/ ’ * 

the input to GPA. Thus, GPA and 1 its respective Shop Grade would be 
expected to correlate quite highly. 



• ' * Question #2 

i ■ ' . I ■ " . - - - 

What combination of ninth grade student character- 
istics most efficiently predict school success as 
measured by tenth year GPpP 

■ ■ ' , , .... 
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By quickly reviewing Table 3, it can be seen that six student char- . . 
acteristic variables correlated significantly with GPA (10th Grade) at 
the .05 level. These were GATB-V, GATB-N, GATB-S, GATB-Q, OVI-Interest 
and Satisfaction and Vocational Maturity. The correlation coefficient's 
obtained between GPA (10th Grade) and the ten remaining student character- 
istic variables were not found to be significant. 

In an effort to answer question 2, a multiple regression analysis 
(MRA^ technique was used. Table 5 shows the predictiveness of the 
criterion, GPA (10th Grade), using all sixteen student characteristic 
variables. The obtained overall F-ratio for ,the full model was 2.6936 
and is significant at the .05 level. The full model predicts a signifi- 
cant portion of the variability of GPA (10th Grade) . The multiple (• 

# , - ‘ i •, 

correlation (R). is not presented in the table, but was found to be .55. 

. 2 
The unadjusted coefficient of determination (R ) also not shown in 

the table, is the multiple correlation squared and is equal to .32. The 

| .—2 

coefficient of determination adjusted for degrees of freedom (R ) was 
computed to be equal to .20. The difference between the unadjusted and 
adjusted coefficients of determination is due to adjustments made to 
account for shrinkage which might occur upon cross-validation. Therefore, 

using all sixteen student characteristic variables, 20 percent of the 1 

■ • : V 1 • •' . . ■ ' * 4 J 

variability of GPA (10th Grade) can be explained. \ — 

From Table 5, it can readily ^be seen that GATB-N is the only variably 
having a’ student "t" significant at the .4)5 level, that is, a value equal 
to or exceeding 1.98. This is to say that GATB-N was the only student 
characteristic variable that was unique enough to predict a significant 
portion of GPA (10th Grade) when taken in combination with all of the 
other fifteen student characteristic variables. Table 5 of this study 
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